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^ Start ) H Choose a learning algorithm. I 



Define Problem, fitness criterion and termination criterion 



Define the machine code structure that is appropriate for the 
problem and the learning algorithm to be used and that 
encodes the Learned Elements and the Conversion 
Elements into machine code. 



iSpecify the input, output, calculation and state registers. 



Determine which portions of the machine code are to be 
changed by the learning algorithm and which portions are 
not. That is, locate the Learned Elements in the machine 
code. 



Determine what changes may be made to what portions of 
the machine code are per the chosen learning algorithm. 



Create Header as Array of Integers 
consistent with above 



Create Footer as Array of Integers consistent 
With above 



I 



Stored 
data 



Create Standard Return Instruction as Array 
of Integers consistent with above 
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Create Leaf Procedure Return Instruction as 
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( End ) 



Details of System Definition 
Fig. 16b 



Predefined 
Header Array\ 



17/49 



( Start 
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, Solution(s) 



For Each Solution used "by 
learning algorithm. Do: 
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Copy Predefined Header to 
beginning of Solution 
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Predefined 
Footer Array 



Predefined 
Standard 
Return Array 



Create Solution Body Based on 
System Definition. Use only input, 
output, calculation and state 
registers in instructions. 



Copy Predefined Footer to 
end of Solution 



Copy Predefined 
Return to end of 
Solution 



Solution Loop 
End 



( End ) 
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Fig. 16c 



"Solution" means entity or individual 



18/49 



C Start > 
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I 



Typecast Solution As 
Pointer to Array of Integers 



Find Information in Solution 
that is to be changed per 
System Definition. That is 
find the Learned Elements 



Uhange the Learned 
Elements using learning 
algorithm by making 
changes to the Solution as 
an Array of Integers 



Prevent or Repair Changes 
to Header, Footer or 
Return Instruction 



End Modification) 



Evaluate Solution(s) 
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C Start Evaluation 



I ypecast Solution as Pointer to 
Function 



Get Input Data For Initializing 
Solution During Execution. Retain 
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Evaluate Solution Based on 
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and the related code into machine code. 



Specify the input, output, calculation and state 
registers. 



Determine which portions of the machine code are to 
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locate the run-time data in the machine code. 
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what portions of the machine code. 
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Typecast Solution As 
Pointer to Array of Integers 



Find Information in Solution 
that is to be changed per 
System Definition. That is 

find the run-time data in the 
Solution. 



Replace the old run-time 
data with new run-time data 
by making changes to the 
Solution as an Array of 
integers. 



Prevent or Repair Changes 
to Header, Footer or Return 
Instruction 



Execute Solution 



Start Evaluation 
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Get Input Data For Initializing Solution 
During Execution. Retain state register 
values as appropriate 
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( Start ) 



Read Run Parameters 



Assign Specific Registers as Input, 
Output, Calculation and State 
Registers 



Create Standard Header as Arrays of 
Integers 



Create Standard Footer as Arrays of 
Integers 



Create Standard Return Instruction 
as Array of Integers 



Define Default Instruction Templates Set. 
Place 32 bit templates for arithmetic, Logical 
and branch instructions that will be used into 
template set. All bits referring to registers or 
constants are set to zero. 



( End ) 
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( Start 
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Allocate Memory For Population 



For Each Individual in 
Population. Do: 



Randomly Choose Length from 
two to "Max Length Individual" 



Copy Predefined Header to 
beginning of Individual 



For each four bytes 
in body of Individual. Do: 
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Create Instruction 



Add New Instruction To Body 



J. 



Four Byte Loop End 
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( Start ) 

Randomly select instruction template from 
"Default Instruction Template Set." 



Clear all parts of selected instruction referring to registers. 
"And" with a binary mask 



Choose an 
a = b + constant 
type instruction 




Set the bit used to identify a 
constant type instruction 



Randomly Choose Two Valid 
Registers From Input, Output, 

Calculation, or State Registers 
and "Or" them into instruction 

with b inary mask 

T — 

Create a r random constant less 
Jhan or eqiuial to "Max Initial 

Constant Bize." "Or" it into the 
instruction with binary mask 



Set the bit used to identify a two 
source register type instruction 



Randomly Choose Three Valid 
Registers From Input, Output, 
Calculation, or State Registers 
and "Or" them into instruction 
with binary mask 
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Start 
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Rand omly (lndiv[1]-lndiv[4]) 

For lndiv[1]-~ 
Indivf41, Do: 



Calculate lndiv[n] Fitness 



I End Fitness Calc Loop J- 
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Replace Worse of lndiv[1] and 
lndiv[2] with Better of lndiv[1] and 
lndiv[2] 
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Replace Worse of lndiv[3] and 
lndiv[4] with Better of lndiv[3] and 
lndiv[4] 
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lndiv[1] and lndiv[3] 
(lndiv[1] and lndiv[3] modified as 
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(jSterT) - — H Initialize Fitness of Indivjnl as Zero Fttnessfnl =~0 | 

[Define "tunction_pr Type as a pointer to an executable function ] 
r For Each Fitnass Casen], Do: ~^ 



Ge * Each input Element of Fitness Case[i] Assign Elements to 
Inputm-lnputrkl ' 



Initialize Calculation and State Registers 
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Typecast lndiv[n] as function_ptr Type. Function[n] = 
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Execute lndiv[nl by calling Functional 
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Calculate Error on Fitness Casep], ( ErronlJ = | Predicted Outputp] '■ 
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Erronll 
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Create text file with appropriate 
header, footer, includes etc to 
constitute a C source file. 



Determine how many subroutines are 
used in individual. 



Declare and Create a C Function 
for each subroutine. In each 
function, declare an integer 

variable for each register used in 
the subroutine, 



For Main and each Subroutine^- 
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Create a line of code in text 
file that corresponds to the 
instruction 



End Instruction Loop 
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( Start ) 



Create Interation Control Leaf 
Procedure That Increments and 

Checks Value of Counter and 
, Protects against Calls > Max 

Iterations. Store Address of 
procedure. 



I 



Define Loop, If/Then/Else, jump and 
other program structures as desired. 
Prevent them from jumping to an 
instruction outside the body of the 
calling code. Call Iteration Control 
Leaf Procedure from within them 
where appropriate. 



Create other Leaf 



Procedures and External 
. junctions as desired. 



Read Run Parameters 
T 



Set Number of Subroutines To 

Be Used. 

I 



Assign Specific Registers as 
Input, Output, Calculation and 
State Registers 



Create Standard and Leaf 

Headers as Arrays of 
Integers 



Create Standard and Leaf 

Footers as Arrays of 
Integers 




Stored 
data 



Create Standard Return 
Instruction as Array of 
Integers 



Start 



Place 32 bit templates for 
arithmetic, logical and branch 
instructions that-will be used 

into template set. All bits 
referring to registers or 

constants are set to zero 




Create Leaf Procedure 
Return Instruction as 
Array o f Integers 
I 



Create Leat Procedures and 
External Functions. Use Leaf 

Header and Footer and Return 

Instructions. 



Start 



Place complete 32 bit call 
instruction into template set for 
each leaf procedure, external 
function or subroutine in run. Calls 
are made to registers L0-L7 




Save Addresses of each Leaf 
Procedure or External Function 

5 



Back 



Define Default instruction 

Templates Set. 



( End ) 
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Allocate Memory For Population 



' For Each Individual in Population. 

Dpj 

( For Main and for each Subroutine. 

Do: 



Randomly Choose Length from two 
to "Max Length Individual" 



T 



Copy Predefined Header to 
beginning of Main or Subroutine 



I 



Initialize Local Registers In Header 



** 



I 



For each four bytes 
in body of Main or Subroutine. Do: 



I 



Create Instruction 



T 



Add New Instruction To Body 



T 



Four Byte Loop End 



I 



Main or Subroutine Loop End 



Copy Predefined Footer to end of 
Main or Subroutine 



T 



Copy Predefined Return to end of 
Main or Subroutine 



Qnd~> 



individual 
Loop End 

Fig. 22c 
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For each subroutine 
higher than Main or 
present Subroutine 



J. 



Insert instructions into 
header that will initialize 

local register with 
address of higher level 
subroutine 
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End Loop 





Stored 
data "* 



^For each subroutine N 
not higher than 
present Subroutine 



Insert instructions into 

header that will 
initialize local register 
with address of dummy 

function. 
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End Loop 



Yes 



Insert instructions in header 
that will initialize local 

registers with Main and all 
Subroutine addresses 



Use Iteration Control Leaf 
Procedure call to protect 
against infinite loops. 




Stored 
data 



For Each External \ 
Function or Leaf 
Procedure 
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Insert instructions 
into header that will 
initialize local register 
with address. 







End External 
Function Loop 



End 
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Randomly select instruction 
template from "Default Instruction 
Template Set." 



Selected 
Instruction is "Call" 
Instruction?. 



Yes 



Clear all parts of instructions referring to registers. 
"And" with a binary mask 



Choose an 
a = b + constant 
type instruction 
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Set the bit used 

to identify a 
• constant type 
--.instruction 



50% 
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Choose an 
a = b + c 
type instruction. 



Set the bit used 
to identify a two 
source register 
type instruction 



Randomly Choose Two Valid 

Registers From Input, 
Output, Calculation, or State 
Registers and "Or" them into 
instruction with binary mask 
I 

Create a random constant 
less than or equal to "Max 
Initial Constant Size." "Or" it 
into the instruction with 
binary mask 



Randomly Choose Three 
Valid Registers From Input, 
Output, Calculation, or State 
Registers and "Or" them into 
instruction with binary mask 
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( Start 



. 1 




Select Four Individuals from 
Population Randomly 
(lndiv[1]-lndiv[4]) 


< . 





For lndiv[1]- 
indivKI. Do: 



calculate lndiv[n] 
Fitness ** 



J 



End Fitness Calc 
Loop 



Replace Worse of lndiv[1] and lndiv[2] with 
Better of lndiv[1] and lndiv[2] 



Replace Worse of lndiv[3] and 
lndiv[4] with Better of lndiv[3] and 
lndiv[4] 



Perform Genetic Operations ** on !ndiv[1] and 

lndiv[3] 

(lndiv[1] and lndiv[3] modified as side effect) 



Termination 
Criteria Fulfilled?- 



No 



Yes 
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( Start > 



Left 
Bracket 



Initialize Fitness of lndiv[n] as Zero 
Fitnessfn] = 0 



Define "function_ptr" Type as a 
pointer to an executable function 



For Each Fitness Case[i], Do: 



Get Each Input Element of Fitness Case[i] 
Assign Elements to lnput[1]-lnput[k] 



Typecast lndiv[n] as function_ptr Type. 
Function[n] = function_ptr (Pointer to lndiv[n]) 



Initialize Input Regist ers with lnput[1]-lnput[k] 



Execute lndiv[n] by calling Functionfn] 



Recover Value in Output Register (Predicted 

Output[i]) 



Calculate Error on Fitness Case[i], 
( Errorfi] = | Predicted Outputfi] - Actual Outputp'J \ ) 



Increment Fitness Value For lndividual[n] 
Fitnessfn] = F itnessfn] + Errorfi] 



End Fitness Case Loop 



Typecast Function[n] as pointer to 
array of integers 



Return Fitnessfn] 



K End ^ ) 



Fig. 22g 
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Probability 
No 




Fig. 22h 
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Start 



i 

Randomly Select among Main and 

Subroutines. Select only one. 

i 



Within Selected Main or 
Subroutine, randomly select one 

instruction within the body. 
(Do not select an instruction in the 
header, the footer or the Return 
Instruction.) 



Create 
Instruction ** 



Replace Selected 
Instruction with 
Newly Created 
Instruction 



Probability Yes 




Clear all parts of 
instructions referring to 
registers. "And" with a 
binary mask 



Set the bit used to 
identify a two source 
register type 
instruction 



Randomly Choose 
Three Valid Registers 
From Input, Output, 
Calculation, or State 
Registers and "Or" 
them into instruction 
with binary mask 



Mutate the Constant Portion of 
the instruction by flipping one 
bit therein. 



End 



Fig. 22i 
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Start 



For i of 1 and 3, Do. 



Randomly Select Main or one of the 
Subroutines in lndiv[i]. Limit further 
operations in loop to this selection. 



A. 



Select two crossover points in the body. The points should 
be selected between complete machine code instructions. 

Call the group of instructions between those crossover 
points: Selected_lnstr[i], 



I 



End Loop 



Will crossover make either 
Winner exceed "Max Length 
Individual?" 



Yes 



. ^ 1 5 2000 



Swap Selected_lnst[3] with^^ 
Selected_lnst[1]. Lengthen and 
shorten code in replacement Indiv to 
accomodate new length. 



End 



iONs 
NTS 



Fig. 22j 
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Start 



Choose an individual to 
decompile. 



Create text file with appropriate header, footer, 
includes etc to constitute a C source file. 






Determine how many subroutines are 
used in individual. 












Declare and Create a C Function for 
each subroutine. In each function, 
declare an integer variable for each 
register used in the subroutine. 





For Main and each 
Subroutine 



I 



For Each Instruction 



Create a line of code in text 
file that corresponds to the 
instruction 



t4t 



End Instruction Loop 



End Loop 



A/. 



'S 



20Q0 



'S 



End 



Fig. 22k 



